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ABSTRACT 

This paper introduces a new class of random processes X(t) whose 
autocorrelation R x (ti,t2) satisfies a relation of the type 

for all ti and t2 in some interval of the t-axis. Such random processes are denoted as 
linearly correlated. This class is shown to include the familiar stationary and 
periodically correlated processes as well as many other, both harmonizable and non- 
harmonizable, nonstationary processes. When a process is linearly correlated for all t 
and harmonizable, its two-dimensional power spectral density S x (o)i,co2) is shown to 
take a particularly simple form, being non-zero only on lines such that coi-cQ2=±rk 
where the rk’s are (not necessarily equally spaced) roots of a characteristic function. 
The relationship of such processes to the class of stationary processes is examined. 

In addition, the application of such processes in the analysis of typical helicopter noise 
signals is described. 

INTRODUCTION 

The concept of dividing random processes into classes having particular 
desirable properties has long been employed. For example, the classes of 
stationaryU), locally stationary( 2 ), periodically correlated( 3 * 4 > 5 ), and harmonizable( 6 ) 
processes readily come to mind." in this paper, a new class of random processes, 
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called linearly correlated, is introduced which includes many of the aforementioned 
processes as well as other interesting processes which fall into none of the above 
classes. The properties of these new processes and their relation to the other classes 
of processes are examined. In addition, an application to helicopter noise, which 
cannot generally be rigorously analyzed as either stationary or periodically correlated, 
is discussed. 

DEFINITION AND EXAMPLES 

Consider the class of random processes X(t) which satisfy the relation 

R .(V l 2) = | J a i R x( t , t, i' t 2 + 'i) 

M - 1 (D 

for all ti and t 2 in some interval of the time axis. Here R x (ti,t 2 ) is the autocorrelation of 
the random process X(t), the aj’s and xj's are real constants, and N is a finite positive 
integer. Such processes will be denoted as linearly correlated. 

As examples of this class of processes, consider: 

1 . Stationary Random Processes 

For a stationary random process, R x (ti, t 2 ) = R x (ti+t,t 2 +t) for all t. In this case, 
the xj's may be taken to be arbitrary and Eq. (1 ) becomes 

R *(V 2 ) = |.2 a i R *( t i +T r , 2 +T i) 

-"xOi-y,.? a i 

ljl=1 

N 

Thus, as long as ^ a = 1 . stationary random processes are in the above class. 

lil-i 1 


2. Periodically Correlated Random Processes 
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For a periodically correlated random process, Rx(ti>t 2 )=Rx(ti+np,t 2 +np) for all n 
where p is the period of the process. In this case, choosing Xj=jp, Eq. (1) becomes 


N 


R x(V t 2) = 2 a i R x ( t 1 +ip.t 2 + jp) 


i =1 


N 


= R 




N 


Thus, again with the requirement a. = 1. periodically correlated random 


i = i 


processes are seen to be members of the above class. 

3. The Wiener Process 

For the Wiener process, R x (ti,t 2 )=cr 2 min(ti,t 2 ) for t>0, where o is constant. Thus, 
assuming Tj>0 for all j, Eq. (1) becomes 


R x(V , 2) =<j 2 min ( t 1 ' t 2) 


N 


N 


= T a.RTt + T.,t +x.)= Y a.o 2 min/t +x., t +x.\ 

, : r. i x v i j 2 o j.p i j v i j 2 j; 


= i 


N 


a i +o2 ,s Vj 


i = i 


i = i 


N N 

For this process, the dual requirements £ a = 1 and £ a . x . = 0 roust be met, 


l 


i J 


lil= 1 ' lib 1 

along with the condition xj>0. As an example, suppose xi=1, X 2 = 2 , ai=2, a2=-1 with all 
others aj's=0. Then 

R x(V , 2 ) = 2 R x( , 1 +1 ' , 2 + 1 )- R x( t , + 2 ’ , 2 +2 ) 

Thus, the Wiener process is linearly correlated for t>0. 
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4. Processes of the Form X(t)=a l Y(t) 

Here a is a real constant and Y(t) is stationary. This is an example of a locally 
stationary random process( 2 ). For such processes, 

R x(V * 2 ) = + ,2 R y('i' * 2 ) 

Thus, for arbitrary x\, Eq. (1) becomes 

R x(V , 2 )=“ 1+l2R y(V t 2) 


N t +t +2 t. 

= ii^, a i“ lR vCi + V 2 +T i) 


t +t 

= a 1 2 R. 


( t l’ 


* 2 ) 


N 2t. 
V a. a J 

DM 1 


N 2t. 

and such processes are seen to be linearly correlated if £ a a J = 1 . For example, 

iii-i ' 

with xi=1 and x?=2, ai=3a* 2 and a 2 =- 2 a -4 and all other aj's=0, 

R x(V y = 3“' 2r x(», + 1, t 2 + 1) - 2a- 4 R x ( tl + 2, t 2 + 2) 

5. Processes of the Form X(t)=t k Y(t) 

Here k is a positive integer and Y(t) is stationary. For such processes, 
Rx(ti,t 2 )=ti k t 2 k RY(ti,t 2 ). Thus, Eq. (1) becomes 
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2 a i x i 


m+ n 


'1 m = n = 0 


li I = i ' [0 otherwise 

then such processes are linearly correlated. For example, suppose k=1 , ti=1, t 2 =2, 

t 3 =3 and ai=3, a2=-3, and a3=1 with ail other aj's=0. Then 


R x(v y = 3 R xC , + 1. y + 1) - 3 R x (', + 2 . ‘ 2 + 2 ) 


+ R x ( t 1 + 3 ' * 2 + 3 ) 

6. Processes where Y(t) is Periodically Correlated 

The previous two examples may be extended to the case where Y(t) is 
periodically correlated by taking Xj=jp where p is the period of the process. 
HARMONIZABILITY 


A random process X(t) is said to be harmonizable if the double Fourier 
transform of its autocorrelation 


s x(“,' “ 2 ) =7^1 .<*1 [ „ d, 2 R x(V ' 2 ) e 


if co t - to t ^ 
VII 2 2/ 


( 2 ) 


exists. The function S x (coi,g) 2 ) is called the two-dimensional power spectral density of 
the random process X(t). 
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Although not all linearly correlated random processes are harmonizable, as can 
be seen from the previous examples, one of the useful properties of linearly correlated 
random processes is that, if they are harmonizable, their two dimensional power 
spectral density takes a particularly simple form. If the random process X(t) is 
harmonizable and linearly correlated for all t, this can be seen by using Eq. (2) in Eq. 

(D. 


N . oo oo 

S Y fco.,G)\= V a. — - f dt f dt_ R ¥ (t. + x.,t /> + xAe 
*\ 1 2 ' | i fr 1 J 4^2 J_oo 1 J-oo 2 x U j’ 2 \) 


if CO t - (0 t ^ 
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This equation can be satisfied if and only if S x (coi,cd 2)=0 everywhere except where 


N 


- 1/(0 -(I) \T 


if.*' 1 


'( 


1 2) j 


= 1 


or, letting o)=coi-£ 02 , at the real roots of the equation 
N — ico-t. 


f(co) = Y a.e 

lifi J 


- 1=0 


(3) 


These roots, co=rk, imply that coi-ci) 2 =rk and thus the two-dimensional spectra can have 
nonzero values only on lines a)i-ci)2=rk parallel to the line co-|=co 2 . One of these roots 
must be co=0 since S x (co.,, co^ = E^X^co^^j which cannot be zero for all coi unless 

X(t)=0. Here 

X((0) = ^ J”xt) to, dt 


is the (generalized) Fourier transform of X(t). 
Thus, 
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N 

f(o)= X 

lil- 


a.- 1=0 
J 


and 


N 


2 «.-i 


= i 


is seen to be a necessary condition for harmonizability. Further, the roots of Eq. (3) 
occur symmetrically since if £o=ri< is a root, 


, (- r k )= , '( r k)=° 

This leads to a two-dimensional spectra with support as shown on Figure 1. 
Processes with this type of spectra have been called "almost periodically correlated" 
by Hurd( ? ). 

In order to develop examples of such spectra, it is useful to introduce the 
change of variables 


into Eq. (2). Then, 


( CO + CO \ 

' - - [x 

2 J_“ J« n «u.v« e 2 ' 


4 it - 

1 . Stationary Random Processes 

All stationary random processes are harmonizable and R X (F, x) = R x (x). In 
this case, the double integral separates yielding 

03 + 0 ) 


(4) 


S x( V “ 2 ) = S xl “ “ 2 ) 


where 8( ) is the Dirac delta function and 
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is the one-dimensional power spectral density of the random process X(t). Thus, the 
two-dimensional power spectra density will have values only along the line coi=co 2 
where Eq. (3) is known to have a root. 


2. Periodically Correlated Random Processes 

Continuous periodically correlated random processes are not necessarily 
harmonizable( 8 ). However, since R X (F, t) = R X (F + np, t) for all n, the 

autocorrelation is periodic in f and may be written 


oo j 2nn f 

R x (F,t)= £ R.We p 

" — - (5) 

Thus, for those periodically correlated processes which are harmonizable, utilizing this 
relation in Eq. (4), 


S *(°Y “2) = 7^2 [ ? We 


j^DZLf _ j/ftj _ a 

e ^ 1 : 
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s " (0)) = sr 13 (t) e '“' dT 

is the Fourier transform of the nth coefficient in the Fourier series for the 
autocorrelation function given by Eq. (5). Thus, the two-dimensional spectra will have 
values only along the lines coi-co2=2n7c/p, n=0, ±1,±2,. . . 

Note that for the case of a periodically correlated random process, one may take 
ai=1 and xi=p with all other aj's=0 in Eq. (1). Then, becomes Eq. (3) becomes 
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- icop 
e 

with roots 


P n=0,±1,±2, ... 

Thus, Eq. (3) will have roots at those points where the two-dimensional spectrum is 
nonzero. 

As an example of this type of spectrum, consider binary noise, B(t). This is a 
simple random process in which the time axis is divided into intervals of length p and, 
for np<t^(n+1)p, P[B(t)=1]=P[B(t)=-1]=1/2. If ti and t 2 are not in the same interval, B(ti) 
and B(t 2 ) are independent random variables. Then, it can be seen that 


1 t. and t in same int. 


R b(V 2 ) lo t andt 


in different int. 


1 2 

as shown in Figure 2. The two dimensional power spectrum of this process may be 
readily obtained by carrying out the integral of Eqn. (4). It is 
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Note that this spectrum is real. 

The amplitude (i.e. coefficients of the delta functions) of this relationship is shown in 
Figure 3 for p=2. 

3. Sum of Two Independent Periodically Correlated Random Processes with 
Incommensurate Periods 
Let 

S(t) = X(t) + Y(t) 


be the sum of two independent, mean zero, periodically correlated random processes 
X(t) and Y(t) with periods pi and p 2 respectively. Further, suppose that the periods are 
incommensurate. Then 
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R $ (t , x) = R x (t ,t) + R y (t , t) 


(6) 


Such a random process is not itself periodically correlated. This can be seen by 
supposing the contrary, that S(t) is periodically correlated with period T. Then, using 
Eqn. (5), Eqn (6) becomes 

Brwcr ^ i2n * r ^ i2 P *I 

R s (F,t)= £ R sn (x)e T = £ R xn (.)e + £ R vn (x)e P2 


n =- ~ 


n = — oo 


n = - «o 


Enrc 


(f + T) 


i2nn 


(f+T) 


= £ R xn (t) 


e 


+ Z R yn (t) 


e 


n=— oo n = -°° 

since, by definition, R s (f, t) = R (f + T, t) . Thus, 


£ R xn w 


'2nn- 


1 -e 


i2nrc 


n = - oo 


+ Z Ryn(^) 


e 

Erwt 


Li - e 


En re 


e 


= 0 


n = — oo 

Fourier transforming this equation with respect to f yields 

Erin. ~ 


I r x „mLi-8 ’ 


n = — oo 


_ 2mrjj 


i-f, 


+ Z Ryn(w -0 


2 me • 


w-®-" 


n = - oo 

This relationship can be true if and only if T/pi=integer=Ni and T/p 2 =integer=N 2 . 
However, this implies that pi/p 2 =N 2 /N-| which violates the assumption that the periods 
are incommensurate. Thus S(t) is not periodically correlated. 

Since the operator of Eq. (2) is linear, assuming that X(t) and Y(t) are 
harmonizable implies that S(t) is harmonizable with two-dimensional spectrum 


S s(°V<“ 2 )= 2 * * S x(«V °> 2 ) + S y(“i' »> 2 ) 
which is of the form shown in Figure 1 for a linearly correlated random process. 
Further, it can be proved that S(t) is, in fact, a linearly correlated process: Let a^=a 2 ='\ 
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and a 3 =-1 with x^p-j, x 2 =P 2 ,x 3 =P 1 +P 2 and al1 other aj's=0. In terms of the transform 
variables f and x, Eqn. (1 ) becomes 

N 

R x (t,t)= E a R x (t +x t) 

II-' (7) 

Thus, for the present example, 

r s (f, t) = R s (r + p v t) + R s (r + p 2 , t) - r s (f + p, + p 2 , t) 


since 

R s ( r+ Pf z ) + R s ( r+ P 2 ’ T ) - R s ( r+ Pi + P 2 ’ T ) 

= R x(F + Pl , T) + R^r + P,. t) + R X (F + p 2 , t) + R^r + p 2 , t) 

- R x( r + p, + p 2 ' T ) - R y ( r + Pi + p 2 ' x ) = R xff . i) + n y (r + p v t) + R x (r + p 2 , x) 
+ R y (f, x) - R x (f + P 2 . x) - R y (f + P v x) 

= R x (f, x) + R y (f, x) = R s (r, x) 

upon use of Eqns (5) and (6). Thus, the sum of two harmonizable, independent, 

periodically correlated processes with incommensurate periods is not only 

N 

y a.= 1 

harmonizable (note that |jT 1 J ) but also linearly correlated. This example is of 

interest in the analysis of helicopter noise where the sound reaching an observer at a 
location fixed relative to the helicopter consists of two periodically correlated, mean 
zero random noise processes generated by the main and tail rotors respectively. 
Ordinarily, the periods of these two signals are incommensurate. This application is 
illustrated in Figure 4. 

RELATIONSHIP WITH STATIONARY PROCESSES 

The class of stationary random processes is familiar and well understood, 
particularly as to the interpretation of its spectra. Thus, it is of interest to attempt to 
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relate this new class of linearly correlated processes with the familiar stationary class. 
However, since all stationary processes are harmonizable, a close relation could only 
be anticipated for the harmonizable subset of linearly correlated processes. This 
attempt is lent credence by the powerful theorem of Miamee and Salehi ( 9 ) who have 
shown that any harmonizable random process is the projection of a stationary process 
in a larger space. 

Perhaps the place to start is with periodically correlated processes which are 
known ( 0 ) to be closely related to stationary processes. If X (t) is a periodically 
correlated random process with period p, then 

oo Bn7t { 

E[X(t)] = X A„e p 

n = - oo 

and 

^ Britt f 

R x (f, t) = X R n (l)e P 

n = — oo 


i.e. its mean is a periodic function of t and its auto correlation is a periodic function of 


t = 


'l +, 2 


Now, define 

Y(t)=X(t-6) 

where 0 is a random variable which is independent of X(t) and uniformly distributed 
over the internal (o, p). 

Then 
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E[Y(t)] = E[X(t - 8)] = E 0 [E x [X(t - 8)|0]] 


i2rm 


= 2 


n =— oo 


j2rm t _ 
p *£ 


= A. 


de 


since 




p 


= 8 

d0 n ° 


where 5nm is the Kronecker delta function. Thus, the mean value of Y(t) is constant. 
In fact, it can be seen that 

E[Y(t)] = £ J Q P E[X(t)]dt = A 0 

is just the average value of the mean of X(t) over the period. Further, 

R y(v y = to y o 2 )]= to - e ) x (t 2 - 0 )] 


= E e[ E »£ x ( t i- e ) x ( t 2 - 9 ) le ]] 


« Mo 

n ?.. R " We P H e_ P 


Thus, the autocorrelation of Y(t) depends only upon the time difference ^t,, — t , 
and the portion of the autocorrelation R x (r, x) which is independent of t" is seen to 
be the autocorrelation of Y(t) . Again, note that 

R y (*)=4( R x (r,x)df= R 0 (x) 
is just the average value of R X (F, x) over a period. 
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Since the mean value of Y(t) is constant and its autocorrelation is only a 
function of the time difference, Y(t) satisfies the definition of a weakly stationary 
random process. Thus, a periodically correlated random process becomes stationary 
under the action of a random phase shift uniformly distributed over its period. Further, 
the power spectral density of the stationary process is 


S y <0)) = '5T 1 „ R y (T,e ~ IWXdt 

= mass of S x (o) 1 , 

i.e. just the mass of the two dimensional spectrum of X(t) which lies along the line 

co=co. 

1 2 

A similar approach can be taken with the sum of two independent periodically 
correlated random processes, when they can be summed with independent random 
phases, since the sum of two independent weakly stationary random processes is a 
weakly stationary random process. However, in the important application to helicopter 
noise signals, the relative phase of the two signals is fixed by mechanical gearing 
within the helicopter drive train. Thus, a different approach must be employed. 

Suppose 

S(t) = X(t) + Y(t) 

is the sum of the two independent, mean zero, periodically correlated random 
processes with incommensurate periods p 1 and p 2 as discussed previously. Recall 

that S(t) is not periodically correlated, but is linearly correlated. Now, let 
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e = e 1 + e 2 


where e 1 ancJ 0 2 are independent random variables uniformly distributed over the 
intervals (o, p.,) and (o, p 2 ) respectively. Assume, without loss of generality, that 
P 1 ^ P 2 - Then, it can easily be shown that 8 is a nonuniformly distributed random 
variable having density function 


8 

PiP 2 


V 0 >H K 


p i +P 2 -0 


PiP 2 


0 <8 <p i 

P^ 0 ^P 2 

p 2 ^8<p i + p 2 


as shown in Figure 5. Define 
Z(t) = S(t-8) 

as the linearly correlated random process after undergoing two random phase shifts. 
Then, 


E[ Z(t)] = E[S(t - 8)] = E fl [E s [S(t - 8) |e]] = 0 


and 


TO z (< 2 )]= E [ s ( , 1 - e ) s ( t 2 - e )] 
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- - 0) l 0 J = ' E„[R s (r- 0. x)] 

= E e [R x (r-0,T)] + E e [ R y (r-0,T)] 


= £ R xn We 
n = — oo 




i2ruc 


- i2n re 


e 


+ E R yn( x > e 2 E J- ( 

n = — oo 

= R xo ( x ) + R yo^ " ^ 5 ~ D ^ ) 


since 


e 


- 12 nn 
n 

1 


6 


= E 


e L 


- i2nn . , 
e 2 0 


= 8 


no 


Thus, the mean of Z(t) is zero and the autocorrelation of Z(t) is seen to depend only 
upon the time difference t which implies that Z(t) is a weakly stationary random 
process as well. This result indicates that the random signals which typically arise in 
helicopter noise measurements can be rendered stationary by the application of two 
random phase shifts. A similar approach can apparently be utilized with any 
harmonizable linearly correlated random process ( 10 ). 
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DISCUSSION AND CONCLUSIONS 

This paper has introduced a new class of random processes, denoted as 
linearly correlated, and has examined the relationship of this class to other classes of 
random processes, in particular stationary, periodically correlated and harmonizable. 
The relations are illustrated by the Venn diagram shown on Figure 6. Stationary 
random processes, which may be viewed as periodically correlated with arbitrary 
period, are a subset of the periodically correlated random processes which are, in turn, 
a subset of the linearly correlated random processes. The class of harmonizable 
processes, which includes stationary processes, contains only some of the periodically 
and linearly correlated processes, although it contains others which are in neither 
class. 

For those processes which are both linearly correlated for all t and 
harmonizable, it was shown that the two-dimensional power spectrum S x ( co 1 , “g) 

takes a particularly simple form, being non-zero only on lines such that co - co = ± r 

1 c. K 

where the r ' s are (not necessarily equally spaced) roots of a characteristic function. 

It was also noted and demonstrated by example that such processes may be 
transformed into stationary random processes by the introduction of a suitably chosen 
phase shift 0, i.e. if X(t) is an arbitrary harmonizable linearly correlated random 
process, then a 0 can be found such that 
Z(t)=X(t-0) 

is a weakly stationary random process. 

What implication does this result have for the analysis of such processes? As a 
concrete example, suppose one has a typical helicopter noise measurement where 
the main rotor and tail rotor have incommensurate periods. The signal is not periodic 
in any sense and thus cannot be analyzed as periodic. However, the above result 
seems to indicate that one can either view the measurement as a sample function from 
a highly nonstationary linearly correlated random process, in which case further 
analysis and its interpretation are more difficult, or one can view the measurement as a 
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sample function from a ' stationary random process, which 

was obtained from the nonstationary process by an appropriate phase shift, in which 
case the further analysis and interpretation is straightforward. How is this strange 
result possible and what does it mean? 

The answer lies in recalling the objective of Fourier analysis which is to 
represent a given time history by a collection of sinusoids. Xi one is content to answer 
the typical question as to the amplitude of the various sinusoidal components required, 
then analysis as a stationary random process is sufficient and will yield a 
representation such that 

S x (“ i '“ 2 ) = E [ X '(“,) X (“ 2 )]= 0 < V “2 

that is, there will be no linear relationship (correlation) between the Fourier 
components at different frequencies. Thus, all phase relationships in the signal will 
have been lost in the representation. However, such linearly correlated signals do 

exhibit linear phase relationships between the different frequency components which 
account for the off-diagonal components in S x (o) 1( co 2 ). Thus, if one is engaged in 

analysis (prediction, filtering, detection, etc.) where phase relationships are important, 
then analysis as a nonstationary linearly correlated process provides much more 
information about the signal and will allow a more optimum analysis. 
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